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Abstract. We prove that for any compact set B C K d and for any e > there is a 
finite subset X C B of \X\ = d°^/ e ) points such that the maximum absolute value 
of any linear function £ : M d — > lonl approximates the maximum absolute value 
of £ on B within a factor of e\fd. We also discuss approximations of convex bodies by 
projections of spectrahedra, that is, by projections of sections of the cone of positive 
semidefinite matrices by affine subspaces. 



1. Introduction and main results 

We present two results on approximating general convex bodies by efficiently 
computable convex bodies in the general spirit of [BV08]. Having fixed a compact 
set B C M. d , we are interested in constructing an algorithm, preferably of a rea- 
sonably low complexity, which allows us to approximate the maximum of a given 
linear function i : IR d — > RonB. 

Our first result describes how well we can approximate B by a finite subset 
X C B of a controlled size. 

(1.1) Theorem. Let B C M d be a compact set. Then for any positive integer k 
there exists a set X C B such that for the cardinality \X\ of X we have 

\x\ < 1 + h( i + 1- 1 ) + l( d + k - 1 ~ 

1 1 - 2 V k J 2 V k 



and such that 



max\£(x)\ < | ^ , ) max|£(x) 
xeb \ k J xex 
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for every linear function £ : R d — > M. 

Let us fix k and let the dimension d grow. Then the cardinality \X\ = of 
X is polynomial in d while for the approximation factor we have 

d + k-l\™ Vd 




k J (k\y/ 2k 

In particular, choosing a sufficiently large k we can replace B by a set X of polyno- 
mially many in d points such that the maximum absolute value any linear function 
on X approximates the maximum absolute value of the function on B within a fac- 
tor e\fd for any e > 0, fixed in advance. To obtain a constant factor approximation 
we have to choose X consisting of exponentially many in d points. 

Next, we consider approximations of convex bodies by more complicated sets. 

In the space M. rXr of r x r real matrices we consider the closed convex cone M^_ Xr 
of symmetric positive semidefinite matrices. A section of M+ Xr by an affine subspace 
is called sometimes a spectrahedron, see, for example, [GNU]. The problem of opti- 
mizing a given linear function on the affine image (projection) of a spectrahedron is 
a problem of semidefinite programming, which, under some technical qualifications, 
can be solved in polynomial time, see, for example, [TulO]. 

The following result was obtained by Gouveia, Parrilo and Thomas [G+10], 
[GT10] in the language of theta bodies. Nevertheless, we give a proof here as it 
connects the topic with the concept of positive semidefinite rank of a matrix in- 
troduced in [F+ll] and [G+ll] and raises some interesting questions. We note, 
however, that the proof uses the same idea as the proof from [GT10], only stated 
in a different language. 

(1.2) Theorem. Let B C Z d be a finite set of integer vectors. For any positive 
integer k there exists a convex set C C W 1 such that the following holds: 

(1) We can write C as a Minkowski sum C = C + C 1 - , where C C W 1 is a 
subspace and C C C is an affine image of a section of the cone of r x r 
symmetric positive semidefinite matrices by an affine subspace with 



d + k + 2 
k 



BcC 



r < 

(2) We have 
and 

(3) For any linear function 

£(x) = a 1 x 1 + . . . + a d x d for x = (xi, . . . , x d ) 

with integer coefficients a±, . . . ,a d such that 

maxf(i) — mm£(x) < k 
2 



we have 



xeB xec 



If k is fixed in advance then r = is bounded by a polynomial in the 

dimension and C approximates the convex hull conv(S) precisely with respect to 
any lattice direction for which the width of the convex hull is bounded by k. If we 
allow the lattice width k to be linear in d, the dimension r of the ambient space for 
the spectrahedron becomes exponentially large in d. 

The paper is organized as follows. 

In Section 2, we discuss some preliminaries concerning (symmetric) tensor powers 
of spaces. 

In Section 3, we prove Theorem 1.1. 
In Section 4, we prove Theorem 1.2. 

In Section 5, we present a related result on approximating non- negative matrices 
by matrices with a small positive semidefinite rank, studied in [F+H] and [G+ll]. 

2. Preliminaries 
We consider Euclidean space R d with scalar product 

d 

( x ,y) = ^2x t y t for x = (xi, . . . ,x d ) and y = . . . , y d ) 
i=i 

and the corresponding Euclidean norm 

||x|| = y/ (x,x). 

For a positive integer k we interpret the tensor product 

(R d ) m =R d ® ...®R d 

k times 

as <i fc -dimensional Euclidean space of arrays X = (xi lm ..i k ), 1 < ii, . . . , ik < d, with 
scalar product 

< X ' y >= Yl x ii...i k Vii...ik for x = (x il ...i k ) and Y = ( yil „ Ak ) . 

l<il,... ,ik<d 

For a vector x G R d , we define x® k G (M d ) (8,fc by 

(x® k ) h . k = x h ■ ■ ■ x ik for 1 < zi, . . . ,i k < d and x = {x u . . . , x d ) . 
We have 

{x m , y m ) = (x, y) k for all x, y G R d . 
3 



We observe that x® k lies in the subspace Sym (R d ) consisting of the tensors 
X = (xi lmmm i k ) for which values of the coordinates do not change when indices 
ii, . . .ik are permuted. We have 




Finally, the space (R d ) is naturally identified with the space ~R dxd of d x d 

matrices while subspace Sym (R d ) ® 2 is identified with the subspace of symmetric 
matrices. For x G R d the matrix x® 2 is positive semidefinite. As is well-known, the 
cone IR^ xd of symmetric positive semidefinite matrices is spanned by matrices x® 2 . 
We have (X, Y~) > for any d x d symmetric positive semidefinite matrices. 

3. Proof Theorem 1.1 

We start with a lemma. 

(3.1) Lemma. Let B C R d be a compact set. Then there exists a set X C B of 
not more than 1 + d ( d + 1 ) points such that for any linear function I : W d — > R one 
has 

max\£(x)\ < y/dmax\£(x)\. 

xEB xEX 



Proof. Without loss of generality we assume that B spans R . We consider the 
(necessarily unique) ellipsoid E C R d centered at the origin and of the minimum 
volume among those which contain B, see, for example, [Ba97]. Applying an invert- 
ible linear transformation, if necessary, we assume that E = {x eM. d : \\x\\ < l} 
is the unit ball. F. John's conditions, see [Ba97], state that there is a finite subset 
X C B and numbers a x > such that 

xex 

and 

xex 

where I is the d x d identity matrix. 

For completeness, we sketch a proof of (3.1.1). If matrix d~ x I does not lie in the 
convex hull of the compact set {x® 2 : x G -B} then it can be separated from the set 
by an affine hyperplane, which implies that there is a quadratic form q : R d — > R 
such that q(x) < 1 for all x G B and such that trace q > d. Then for a sufficiently 
small e > the ellipsoid E defined by the inequality 

(1 - e)\\x\\ 2 + eq(x) < 1 
4 



(3.1.1) 



contains B and has a smaller volume, which is a contradiction. 

Car at heo dory's Theorem then implies that we can choose \X\ < 1 + The 
first equation of (3.1.1) can be also written as 



a x (c,x) 2 = -\\c\\ 2 for all c G R d , 



d 



from which it follows that 



max|(c,x)| > -7=||c|| > -j= max | (c, x) | . 



□ 



(3.2) Proof of Theorem 1.1. Let us consider 

B k = {x m : XEB}. 

Thus Bk is a compact subset of a 1 ) -dimensional space Sym(M d ) . Applying 
Lemma 3.1 we conclude that there exists a subset X C B such that 

1 1 - 2V fc / 2 V fe 

and such such that 

max|(y, x® k )\ < + f _1 V 2 max|(y, x® k )\ 
xeB 1 N 71 \ k J xex 1 x 71 

for any F G Sym (IR^) 81 . Choosing Y = y® k we conclude that 

d + k-1^ 1/2k 



max\(y,x)\ < max|(y,a:)| 
ieB \ k J xex 

for any y G M d , which completes the proof. □ 
It follows from our proof that we can choose the set X among the contact points 
of the ellipsoid of the minimum volume centered at the origin and containing the 
set B k = \x® k : x G B). 

4. Proof of Theorem 1.2 

We deal with real matrices A = (oy) for i 6 I and j G J, where I and J are 
possibly infinite sets of indices. We say that 

rank A < n 
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if there exist vectors itj G M. n for i G I and •Uj G M n for j G J such that 
ttij = (ui,Vj) for all i£/ and all j G J. 

We say that 

rank A = n 

if n is the smallest non-negative integer satisfying rank A < n. We can define 
rank A = oo if there is no such n, but we will only deal with matrices of a finite 
rank. Our definition agrees with the usual definition of the rank of a matrix, when 
/ and J are finite. 

We need some concepts and results of [F+ll] and [G+ll]. 

(4.1) Definition. Let A = ((%•), i G I, j G J be a non-negative matrix. We say 
that 

rankp S( j A < r 

if there exist r x r symmetric positive semidefinite matrices Ui for % G I and Vj for 
j G J such that 

a-ij = (Ui, Vj) for all 

The following result was proved in [F+ll] and [G+ll]. For completeness, we 
present its proof here. 

(4.2) Lemma. Let {ui : i G /} C R d and {vj : j G J} C R d be sets of vectors 
such that 

(ui,Vj) < 1 for all 

Suppose further that span (vj : j G J) = M. d . 
Let us define matrix A = (a^) by 

aij = 1 - (u^ vj) for all 

Suppose that 

rankp S d A < r. 

Then there exists a convex set C cM. d which is an affine image of a section of the 
cone of r x r symmetric positive semidefinite matrices by an affine subspace such 
that 

Ui G C for all % G I 

and 

(x, vj) < 1 for all j G J and all x G C. 

Proof. Since rank pS( j A < r there exist r x r positive semidefinite matrices Ui and 
Vj such that 

(4.2.1) l-(u il v j ) = (U il V j ) for all i,j. 
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Let us define an afline subspace C C R d © W Xr by the equations 
(4.2.2) l-(x,v j ) = (X,V j ) for j G J, 

where x G K d and X G M rXr . The map 

(x,X) i— >■ X 

projects £ onto an affine subspace ^4 C M rXr . We claim that for every X £ A there 
is a unique x G M d such that (x,X) G £. Indeed, if (x,X) G £ and (y, X) G £, 
then 

(x - y, Vj) =0 for j G J 

and since the set {i^- : j G J} spans W 1 we conclude that x = y. This allows us to 
define an affine map (projection) 

T : A — >R d 

by letting 

T(X) = x if (x,X)g£. 

We let 

C = T(Af]R r + Xr ) . 

Since by (4.2.1)-(4.2.2) we have (it*, L^) G £, we conclude that Ui e A and T (l^) = 
itj. Since £/j G R+ XT ", we have Ui E C for all z G /. 

Let us pick any x G C. Then there exists an X G M!j_ Xr such that (x, X) satisfies 
(4.4.2). Since Vj G R+ Xr we have (X, Vj) > for all j and hence (x,Vj) < 1 for all 
jEJ. ' ^ " " □ 

The following observation is also from [F+ll] and [G+ll]. 

(4.3) Lemma. Let A = (a^) and B = (6^-) for % G / and j <E J be matrices such 
that 

a ij = b ij for all 

Then 

rankp Sc j A < rankS. 

Proof. Let rankS = d. Then there exist vectors Ui,Vj G M. d such that 
bij = (ui,vj) for all % G / and all j G J. 

Then 

flii = («f 2 ,«f 2 > for all 
Since uf 2 and w® 2 are d x d positive semidefinite matrices, the result follows. □ 

The following result is a standard linear algebra fact. 

7 



(4.4) Lemma. Let A = (ay) be a real matrix and let p : R — > M. be a polynomial 
of degree k. Let us define a matrix B = (bij) by 

bij = p (bij) for all i <E L and all j G J. 

Then 



rank B < 



k + rank A 

k 



Proof. We write 

k 

p(t) = £ a m t m 
for some a m G R. Let rank A = d, so 



dij = (ui,Vj) for all i,j 

and some vectors Ui : % G J and : j G J in R d . Then we can write 

k k 

bij = p (dij) =a +J2 a j( U i> V oT = "0 + a rn(u? m , vf™). 

m=l m=l 

Let us introduce vectors 

Ui = a © ami © «2«f 2 © • • • © oikuf k and V,- = 1 © vj © vf 2 © ... © w® fc 
in Euclidean space 

R©R d ©(R d )® 2 ©...©(R d )® fc . 

Hence we can write 

bij = (Ui, Vj) for all 

It remains to notice that the dimension of the space spanned by vectors Ui and Vj 
does not exceed 

k 

d + m — 1\ / d + k 



l+]TdimSym(R d f m = l+]r f 

m=l m=l ^ 



m / V k 



□ 



(4.5) Corollary. Let A = (a y ) for i G I and j G J be a real matrix, let Scl, 

S = {aij : i e I, j e J} , 

be the set of all distinct values among the matrix entries a y - and let : S — > R be 
a function. Let us define a matrix B = (bij) by 

bij = (p(aij) for all 

If\S\ < k then 



rank B < 



k — 1 + rank A 
k-l 



Proof. Since \S\ < k there is a polynomial p : R — > R with degp < k — 1 such that 
0(t) = p(t) for all t G S 1 , so o^- = p (oy). We write 



fc-i 



m=0 



for some a m G R. The proof follows by Lemma 4.4. □ 

(4.6) Lemma. Let A = (ay) 6e a reaZ non-negative matrix such that the number 
of distinct values among the matrix entries does not exceed k. Then 



rank psd A < 



fe — 1 + rank A 
k-l 



Proof. Let us define a matrix B = (bij) by 

bij = yfa~ij for all 

By Corollary 4.5, 



rank B < 

Since 



k — 1 + rank A 
k-l 



a ij = bij for all i, j, 
the proof follows by Lemma 4.3. □ 
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(4.7) Lemma. Let {ui : i e 1} C R d and {vj : j G J} C R d be sets of vectors 
such that 

(ui,Vj) < 1 for all 

Let 

C — span (v j : j G J) . 
Let us define a matrix A = (aij) by 



= 1 — (ui, Vj) for all i G / and all j G J. 



Suppose further, that the number of distinct values among the entries does not 
exceed some positive integer k. 

Then there exists a convex set C C R d such that the following holds: 

(1) We can write C as a Minkowski sum C = C + C?- , where C C C is an 
affine image of a section of the cone ofrxr symmetric positive semidefinite 
matrices by an affine subspace for 



r < 

(2) We have 



k + d\ 

k-ir 



Ui G C for all i E I 

and 
(3) We have 

(x,vj) < 1 for all j G J and all x G C 

Proof Since rank A < d + 1 it follows by Lemma 4.6 that 

a / f k + d 
rankp Sd A < I _ ^ 

Let u[ be the orthogonal projection of Ui onto C By Lemma 4.2, there exists a 
convex set C C £ which is an affine image of a section of the cone of r x r symmetric 
positive semidefinite matrices by an affine subspace for 



r < 

such that 



k + d 
k-1 



u\ G C for all i e I 

and such that 

(x,Vj) < 1 for all x G C and all j G J. 
Then C = C + C 1 - satisfies the desired conditions. □ 



10 



(4.8) Proof of Theorem 1.2. We consider R. d as the coordinate hyperplane 
Xd+i = of R d . For a vector x G M. d and aGKwe denote by (x, a) G IR d+1 the 
vector obtained from x by appending the (d+ l)-st coordinate equal to a. 

For a vector u E B let u = (w, 1) G Z d+1 and let {w^ : i G /} be the set of vectors 
obtained this way. 

For any vector v G Z d and any m G Z such that 

max(«, v) = m and min(w, u) > m — k 

ueb ueB 

we let v = (v,k — m) G Z d+1 and let {wj : jG J} be the set of all vectors obtained 
this way. In particular, 

max(M t , Vj) = k and min^i, Vj) > for all j G J. 

/ /'• / 

We define matrix A = (ay) by 

ciij = 1 — —(ui,Vj) for all i G / and all j G J. 

Hence we have < ciij < 1 and kciij G Z for all i and j. In particular, the number 
of distinct values among the entries a^- does not exceed k + 1. 
Let 

£ = span (^j : j G J) . 
Since vector (0, /c) is among vectors Vj, we have 

£ x c R d . 

By Lemma 4.7, there is an affine image C C C of a section of the cone of r x r 
symmetric positive semidefinite matrices with 



r < 



k + d + 2 
k 



such that for C = C + C 1 - we have 

Ui G C for all z G / and (x,Vj) < k for all x G C and all j G J. 
Let us define 

C" = {x G M d : (x,l) G C'} and C = C" + £ ± . 
Since £- L C M d we have 



C={xGM d : (i,l)eCj. 
11 



We observe that C is an affine image of a section of the cone of r x r positive 
semidefinite matrices and that 

B CC. 

Moreover, if for some v E Z d and some integer m we have 

max(«, v) = m and min(-u, v) > m — k 
ueB ueB 

then (y, k — m) = Vj for some j e J and 

(x, v) < m for all igC. 
Since B C C we necessarily have 

max(x, u) = m. 

□ 

5. Approximating non-negative matrices by 
matrices of a small positive semidefinite rank 

As a by-product of our proof of Theorem 1.2 we obtain the following result. 

(5.1) Theorem. For any e > there is a positive integer d = d(e) such that the 
following holds. Let A = (a^), i<El,j<EJbea matrix such that 

< aij < 1 for all 
Then there exists a non-negative m x n matrix A' = (a^) such that 

\ a ij ~ a ij\ — e for all i,j 

and 

rank psd A' < (rank A) d . 

Proof. Without loss of generality, we assume that rank A > 2 and that e < 1/2. 
There is a univariate polynomial p(t) of some degree k = k(e) such that 



(5.1.1) Vt-p(t) 
We let B = (b i:j ) by 



< - for all < t < 1. 

_ 3 _ _ 



bij = p (aij) for all 

By Lemma 4.4 that 

, „ fk + rank A 
rankS < I 

12 



Let us define A' by 

a 'ij = h 1j for a11 hJ- 
It follows by (5.1.1) that a'- approximates Oy within e. By Lemma 4.3 

rankp S( j A' < rank B < 

and the proof follows. □ 

It would be interesting to find out if Theorem 5.1 leads to any non-trivial ap- 
proximations of general convex bodies by projections of spectrahedra. So far, the 
author was unable to beat the bounds established by Theorem 1.1. 
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